ZERO PATTERNS AND UNITARY SIMILARITY 

Q^". JINPENG ANi'2 AND DRAGOMIR Z. DOKOVICi 

o 

^vl ! Abstract. A subspace of the space, L{n), of traceless complex 

■ nxn matrices can be specified by requiring that the entries at some 

flj , positions {i,j) be zero. The set, /, of these positions is a (zero) pat- 

^S ■ tern and the corresponding subspace of L(n) is denoted by Lj{n). 

A pattern / is universal if every matrix in L{n) is unitarily similar 
to some matrix in Li{n). The problem of describing the univer- 
sal patterns is raised, solved in full for n < 3, and partial results 
obtained for n — A. Two infinite families of universal patterns are 

P^ I constructed. They give two analogues of Schur's triangularization 

P^ ■ theorem. 

a 
^- 

1. Introduction 
CN ■ This paper is a sequel to our paper [Ij where we studied the universal 



l> 



> 

O 



subspaces V for the representation of a connected compact Lie group G 



00 . on a finite-dimensional real vector space U. The meaning of the word 

Y^ [ "universal" in this context is that every G-orbit in U meets the subspace 

V. The general results obtained in that paper have been applied in 
(^ . particular to the conjugation actions A — > XAX~^, X G G, of the 

OO ! classical compact Lie groups G, i.e., U(ra), S0(r2) and Sp(r7,), on the 

S^ I space of n X n matrices M{n, C), M(n, R) and M(n, H), respectively. 

(By H we denote the algebra of real quaternions.) 
S^ . In the present paper we restrict our scope to the complex case, i.e., 

H ! to M{n) = M(n, C) and G = U(n). However, all results where we 

establish the nonsingularity (see Section [3] for the definition) of cer- 
tain patterns are directly applicable to the real and quaternionic cases. 
Throughout the paper we denote by L{n) C M(n) the subspace of 
traceless matrices, and by T„ C U(n) the maximal torus consisting of 
the diagonal matrices. We shall consider only a very special class of 
complex subspaces of M{n); those that can be specified by requiring 
that the matrix entries in specified positions {i,j) vanish. We denote 
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the set of these positions {i,j) by / and denote by Mi{n) the corre- 
sponding subspace. We also set Ljiji) = L{n) fl Mj{n). We refer to 
/ as a (zero) pattern and denote the set of all such J's by Vn- A pat- 
tern is strict if it contains no diagonal positions. It is proper if it does 
not contain all the diagonal positions. We say that a pattern I E Vn 
is universal if the subspace Li{n) is universal in L{n). We point out 
that, for a strict pattern I G Vn, Li{n) is universal in L{n) iff Mj{n) 
is universal in M{n). 

The main question we consider, the universality problem, is to de- 
termine all universal patterns in Vn- In full generality, this problem is 
solved only for n < 3. There is a simple necessary condition for uni- 
versality of a proper pattern /: \I\ < fin = n{n ~ 1) /2 (see Proposition 
12.41 below). We denote by V'^ the set of strict patterns I E Vn with 
\I\ = fin- Theorem 5.1 of [1] provides a sufficient condition for the uni- 
versality of a pattern (see Theorem 13.81 below). We use this result to 
construct some infinite families of strict universal patterns. The main 
results in this direction are Theorems 15.11 and 16.21 

In Section [2] we define the universal patterns and state the universal- 
ity problem for patterns I E Vn- The case n = 2 is easy: All patterns 
I EV2 oi size 1 are universal. The nonsingularity of all I eV'^ has been 
established in [1]. In Proposition 12.61 we show that none of the proper 
nonstrict patterns / G P3 of size 3 is universal. Thus the universality 
problem is solved for n < 3. A proper pattern / G P„ is n-defective 
if the stabilizer of Li{n) in U(n) has dimension larger than n^ — 2|/|. 
Such patterns are not universal. 

In Section [3] we introduce the nonsingular patterns. We say that 
I E Vn is n-nonsingular if xi ^ ^('^); where Xi ^ ^[xi, - - - ,Xn] is 
the product of all differences Xj — Xj, [i,]) G /, and /C(n) is the ideal 
generated by the nontrivial elementary symmetric functions of the Xj's. 
The basic fact, that nonsingular patterns are universal, was proved in 
[T]. We say that a pattern I is simple if (z, j) G / implies that (j, i) ^ /. 
All simple patterns are nonsingular, and so universal. A pattern I eV^ 
is n-exceptional if it is ra-singular but not n-defective. There is no 
general method for deciding whether an exceptional pattern / G P^ is 
universal. Proposition l3.3l provides a simple method for testing whether 
a pattern I E V'^is nonsingular. The inner product (-, ■) used in the 
proposition is defined in the beginning of the section. 

In Section m we introduce two equivalence relations "~" and "~" in 
V'n- We refer to the former simply as "equivalence" and to the latter 
as "weak equivalence". This is justified since I ^ I' implies / ~ I'. If 
I ^ I' then I is universal iff /' is universal, but we do not know if this 
also holds for weak equivalence. However, if / ~ /' then I is nonsingular 
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iff I' is nonsingular. For any pattern I we define its complexity v{I) 
as the number of positions («, j) with i < j such that both {i,j) and 
(j, i) belong to /. The patterns of complexity are exactly the simple 
patterns. We show that for n > 4 the set of patterns of complexity 1 
in V'j^ splits into two weak equivalence classes. One of these classes is 
singular and the other nonsingular. 

In Section[5]we consider a particular sequence of nonsingular patterns 
An G V^, n > 1, of maximal complexity, i.e., with z^(A„) = [/i„/2]. For 
convenience let us write n = Am + r where m,r > are integers 
and r < 4. The pattern A„ consists of all positions {i,j) with i ^ 
j and i + j < n + 1, except those of the form {2i — l,n — 2i + 1) 
and {n — 2i + 1, 2i — 1) with 1 < i < m, and if r = 2 or 3 we also 
omit the position (2m + 2,2m + 1). As A„ is nonsingular, it is also 
universal, i.e., every matrix A G M{n) is unitarily similar to one in 
the subspace M\^{n). Thus we can view this result as an analogue of 
Schur's theorem. The whole section is dedicated to the proof of this 
result. 

In Section [H] we consider an infinite family of patterns J{a, i) de- 
pending on an integer n > 1, a permutation a E Sn and a sequence 
i = {h, ^2, ■ ■ ■ , in-i) of distinct integers. This sequence has to be chosen 
so that, for each k, \ik\ G {(t(1), 0"(2), . . . , cr(A;)}. The pattern J(cr, i) 
consists of all positions (ikjO'iJ)) with ik > and {a{j),—ik) with 
ik < 0, where in both cases 1 < k < j < n. The main result of this 
section (Theorem 16.21) shows that all the patterns J{a, i) are nonsingu- 
lar. As a special case, we obtain another analogue of Schur's theorem 
(see Proposition 16. 4p . 

In Section [7] we consider the exceptional patterns / G P4. Up to 
equivalence, there are seven of them (see Table 2). We prove that the 
first two of them are not universal while the third one is. This is the 
unique example that we have of a strict pattern which is singular and 
universal. For the remaining four patterns in Table 2 the universality 
question remains open. The same question for the nonstrict patterns 
in V4 remains wide open. 

There are other interesting questions that one can raise about the 
subspaces Li{n) and the unitary orbits Oa = {UAU~^ : U G l]{n)}, 
A G L{n). For instance, ii Lj{n) is not universal we can ask for the 
characterization of the set U(n) ■ Lj{n). Another question of interest 
is to determine the number, Na,i, of T„-orbits contained in the inter- 
section Xa = Liiji) n Oa- For instance, if Li{n) is the space of upper 
(or lower) triangular traceless matrices and A G L{n) has n distinct 
eigenvalues then Na,i = n\. 
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In Section [H] we consider a pattern I & V^ and a matrix A G L{n) 
such that Xa 7^ 0- The homogeneous space J^n = U(n)/T„ is known as 
the flag manifold and we refer to its points as flags. If g~^Ag G Lj{n), 
g G U(n), we say that the flag gTn reduces A to Lj{n). We say that A 
is generic if Xa and Li{n) intersect transversally (see the next section 
for the deflnition). For generic A, we show that Na,i is equal to the 
number of flags which reduce A to Lj{n). 

In Section M we consider the case n = 3 and the cyclic pattern / = 
{(1, 3), (2, 1), (3, 2)}. We know that / is nonsingular and so U(3) ■ 
Li{3) = L{3). We show that the set of nongeneric matrices A G 
L(3) is contained in a hypersurface F deflned by P = 0, where P is a 
homogeneous U(3)-invariant polynomial of degree 24. This polynomial 
is explicitly computed and we show that it is absolutely irreducible. 
The restriction, Pj, of P to L/ factorizes as P/ = PfP2, where Pi 
and P2 are absolutely irreducible homogeneous polynomials of degree 
6 and 12, respectively. Thus, F fl L/ = Fi U F2 where Fj C Lj is the 
hypersurface deflned by Pj = 0, z = 1,2. The hypersurface Fi consists 
of all matrices A G L{3) such that Oa and Lj meet non-transversally 
at A. 

We propose a conjecture (see Section [3]) and several open problems. 

For any positive integer n we set Z^ = {1, 2, . . . ,n} and /i„ = 
n{n — l)/2. If ^ is a Z-graded algebra, we denote by Ad the ho- 
mogeneous component of A of degree d. We use the same notation for 
the homogeneous ideals of A. 

We thank the referee for his suggestions regarding the presentation 
and some minor corrections. 



2. Universal patterns 

Let M{n) denote the algebra of complex nxn matrices and L{n) its 
subspace of matrices of trace 0. We are interested in subspaces of M{n) 
or L{n) which can be specifled by zero patterns. For that purpose we 
introduce the notion of patterns. 

A position is an ordered pair {i,j) of positive integers. We say that a 
position {i,j) is diagonal ii i = j. A pattern is a flnite set of positions. 
A pattern is strict if it has no diagonal positions. The size of a pattern 
I is its cardinality, |/|. If /, /' are patterns and I ^ I' then we say 
that /' is an extension of I. We denote by V the set of all patterns and 
by Vn the set of patterns contained in Z„ x Z„. We denote by V!^ the 
subset of Vn consisting of the strict patterns of size /i„. The "n x n 
zero patterns" used in our paper [1] are the same as the patterns in V'^. 
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We define an involutory map T : V ^ V, called transposition, by 
setting /^ = {(j, i) : (^,j) G /} for I E V. We refer to /^ as the 
transpose of I. We say that I is symmetric if I^ = I. The sets Vn 
and P^ are T-invariant for all n. Note that if / G P„ is universal (or 
nonsingular) then J^ has the same property. 

For / G Vn, we denote by M/(n), or just M/ if n is fixed, the subspace 
of M{n) which consists of all matrices X = [xij] such that Xij = for 
all {i,j) e I. We also set L/(n) = L{n) n Mi{n). 

Some important patterns in Vn are the diagonal pattern A„ = {(i, i) : 
i G Z„} and the four triangular patterns: 



NE„ = 


= {(2,j)ez„xz„ 


: ^ < j}, 


sw„ = 


= {(z,j)ez„xz„ 


: ^ > j}, 


NW„ = 


= {(z,j)ez„xz„ 


:i+j <n + l}, 


SE„ = 


= {(2,j)ez„xz„ 


:i+j >ri + l}. 



The first is the upper triangular and the second the lower triangular 
pattern. Note that, according to this terminology, if / is the upper 
triangular pattern, then Mj is the space of lower triangular matrices. 
The unitary group U(n) acts on L{n) by conjugation, i.e., unitary 
similarities. 

Definition 2.1. We say that a real subspace V C L{n) is universal in 
L{n) if every matrix in L{n) is unitarily similar to a matrix in V . We 
also say that a pattern / G Pn is n-universal if the subspace Li{n) is 
universal in L{n). 

The prefix "n-" will be supressed if n is clear from the context. This 
convention shall apply to several other definitions that we will introduce 
later. 

It is obvious that a strict n-universal pattern is also m-universal for 
all m> n. The converse is not valid, e.g., the pattern {(1, 2), (2, 1)} is 
3-universal but not 2-universal. 

We are interested in the (pattern) universality problem, i.e., the 
problem of deciding which patterns / G P„ are universal. It is easy to 
see that, for a strict pattern I E Vn, the subspace Lj{n) is universal 
in L{n) iff the subspace Mi{n) is universal in M{n). The Schur's 
triangularization theorem asserts that the triangular patterns NE„ and 
SW„ are n-universal. 

It is well known that A„ is n-universal [5l Theorem 1.3.4] for all n. 
However, if i,j G Z„ and i ^ j then the next example implies that the 
pattern A„ U {{i,j)} is not universal. 
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Example 2.2. The pattern / = {(1, 1), (1, 2), (2, 2)} is not n-universal 
for n>2. Let D = diag(l, . . . , 1, 1 - n) G L{n) and let A G Lj{n). As 
the rank of D — id is 1 and that of A — id is at least 2, D and A are 
not similar. Consequently, Lj is not universal. This implies that NW„ 
is not n-universal for n > 4. For the case n = 3 see Proposition 12.61 

We give another example of a nonuniversal nonstrict pattern. 

Example 2.3. The pattern J = {{i, 1) : 1 < i < n} U {(l,n)} is not 
n-universal for n > 2. Let D be as above and let A = [aij] G Lj{n). 
Assume that D and A are similar. Since D — id has rank 1, A — id 
must also have rank 1. Thus 



-1 



and 



-1 aij 
aj, - 



for 1 < j < ra, 



i.e., Qjj = 1 for I < j < n. As A G Lj, we have an = contradicting 
the fact that tr (A) = 0. Consequently, Lj is not universal. 

If n — 1 of the diagonal entries of a matrix A G L{n) vanish then all n 
of them vanish. For that reason we introduce the following definition: 
We say that a pattern / G P„ is n-proper if (i, i) ^ I for at least one 
i G Z„. Observe that, for any pattern I G Vn, the subspace L/(n) 
is stabilized by the maximal torus T„. An easy dimension argument 
shows that the following is valid, see [H Lemma 4.1]. 

Proposition 2.4. Let I E Vn be proper and universal. Then the di- 
mension of the stabilizer of Lj{n) in \]{n) does not exceed n^ — 2\I\. In 
particular, n < n^ — 2\I\, i.e., \I\ < fin- 

Thus we have a simple condition that any proper universal pattern 
I EVn must satisfy: |/| < /i„,. 

We say that a proper pattern I EVn is n- defective if the dimension 
of the stabilizer of Lj{n) in U(n) is larger than n^ — 2|/|. By the 
proposition, such patterns are not universal. Note that any proper 
pattern / G P„ with |/| > yU„ is defective. 

Next, we show that some special extensions of strict universal pat- 
terns are also universal. For I E V and integers m, n > we denote by 
(m, n) + I the translate {{m + i,n + j) : {i,j) G /} of /. 

Proposition 2.5. Let I E Vn and J G Vm-n, m > n, be strict patterns 
and assume that I is n-universal and J is {m — n) -universal. Then the 
pattern 

I' = IU {{n, n) + J)U ((0, n) + Z, X Z„„,) 

is m-universal. 
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Proof. Given a matrix A G L{m), choose X G U(?Ti) such that B = 
XAX^^ is lower triangular. Let Bi resp. B2 denote the square sub- 
matrix of B of size n resp. m — n m the upper left resp. lower right 
hand corner. Since I and J are strict and universal, there exist matri- 
ces Yi G U(n) and Y2 G U(m - n) such that Fi^iFf ^ G M/(n) and 
^252^2^^ e Mj(m - n). Thus if F = Fi © F2, then Ffiy-^ G L/,(m). 



Hence / is m-universal. 



D 



Let us fix a positive integer n and a pattern / G Pj!,. For A G -^(^) 
we denote by Oa the U(n)-orbit through A, i.e., Oa = {UAU^^ : U G 
U(n)}. The set Xa = Li{n) fl Oa is closed and T^-invariant. We say 
that Oa intersects L/ transversally at a point B G Xa if the sum of 
Liiji) and the tangent space of Oa at B is equal to the whole space 
L{n). If this is true for all points B G Xa-, then we say that Oa and 
Li intersect transversally, and that the matrix A and its orbit Oa are 
I-generic. We shall denote by A'yi/ the cardinality of the set XA/Tn 
(the set of T„-orbits in Xa). We note that Na,i is finite if A is /-generic, 
see Section [8] and [H Section 4]. 

Almost nothing is known about the universality of the subspaces 
Li{n) of L{n) for nonstrict patterns /, but see the above examples. 
The case n = 2 is easy and we leave it to the reader. Let us analyze 
the case ra = 3. The case of strict patterns, P3, has been handled in 
pp. It is easy to see that any pattern / G P3 of size 2 is universal. 
By taking into account the above examples and the fact that A3 is 
universal, there are only four cases to consider: 



0* 
* * 
* * * 



* * 

* * 

* * 



0* 

* * * 

* * 



0* 

* * 

* * * 



(The starred entries are arbitrary, subject only to the condition that 
the matrices must have zero trace.) 

We shall prove that none of them is universal and thereby complete 
the solution of the universality problem for n = 3. 

Proposition 2.6. For n = 3, no proper nonstrict pattern of size 3 is 
universal. 

Proof. We need only consider the four subspaces, V, mentioned above. 
It turns out that in all four cases there exists a diagonal matrix D G 
L(3) such that C^ n ^ = 0. 

In the first two cases the proof consists in constructing an U(3)- 
invariant polynomial function P : L{3) -^ R which is nonnegative on 
V and negative on the diagonal matrices D = diag(M, v, —u — v) when 
u and V are linearly independent over R. The polynomial P will be 



J. AN AND D.Z. DOKOVIC 



expressed as a polynomial in the U(3)-invariants ik given in Appendix 
A. We shall write u = Ui + iu2, Ui,U2 G R, and similarly for other 
variables. 

For the first subspace we define 

P = {2U + 3i5-i6f + Aii{i2- is) {iiH- 615)+ 4:ij{iii5 + 18-17) 
+4:iii2{iG - i^) + 4i8(5i3 - 422) + 1623(2^2 - ^3) 
+4^7(2^2 - 3^3) + 4^2(^2 - 5^3) + 8{iiiu - iis)- 

A computation using Maple shows that for 



A 



X 
z y 

U V —z 



ev 



we have 



P{A) = (|-u|^ — |a;p)^ (|a; — u\'^zl — 4(-Uia;2 + U2Xi)ziZ2 + |a; + u\'^zl) . 

On the other hand, we have P{D) = — 64(-uif2 — U2Vi)'^. 

For the second subspace we define P = if + 4(^3 — 22) • One can easily 
verify that for 

X y 
A= u z ^V 

V —z 



we have 



P{A) 



{\u? + \v? 



\x\ 



\y 



2\2 



while P{D) = — 4(-Uif2 — U2Vi)'^. 

For the remaining subspaces we have more elementary arguments. 

In the third case let D = diag(l,C,C^) G ^(3), C = (-1 + iVS)/2. 
Since D is a normal matrix, its field of values, F[D), is the equilateral 
triangle with vertices 1, (, ('^. Assume that D is unitarily similar to a 
matrix A = [aij] G L/. As A G L/, 022 is an eigenvalue of A and so 
^22 G {1,C,C^}- As ti (A) = and an = 0, we deduce that 033 = 
— 022 ^ F{D). Since F{D) = F{A) and 033 is a diagonal entry of A, 
we have a contradiction. 

In the last case let D = diag(l,i, — 1 — i) G L{3). Assume that D is 
unitarily similar to a matrix 



A 









X 


y 


z 





u 


V 


— z 



eV. 
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Since D is a normal matrix, so is A. From AA* = A* A we obtain the 
system of equations 



xz = zu, zy = —vu, yu = —2zv, 

kP = li/P + 1""!^) \y\ = l"^!- 

Assume that z = 0. Then uy = 0. As A must be nonsingular, we have 
y y^ and u = 0. Thus A'^ is a scalar matrix. Since D^ is not, we have 
a contradiction. 

We conclude that z ^ 0. The equation xz = zu implies that |x| = |m|, 
which entails that y = f = 0. Hence z is an eigenvalue of A, and so 
z G {1,^, —1 — i}- By switching the first two rows (and columns) of 

r X 1 

A, we obtain the direct sum \z] © B where B = . Hence 

^ -' u —z 

G F{B). This is a contradiction since B is normal, and so F{B) is 
the line segment joining two of the eigenvalues of D. D 

The following theorem provides an infinite collection of universal 
patterns. It is an easy consequence of a result of Kosir and Sethuraman 
proven in |^. 

Theorem 2.7. The pattern 

((0, 1) + NE„_i) U {(z, 1) : 2 < i < n} U {(n, 2)} , n > 3, 

is n-universal. 

Proof. Denote this pattern by J . Let A G M{n) be arbitrary. By [U 
Theorem A.4], there exists S G GL(n, C) such that SA*S-^ G Mj\n) 
and SAS~^ G Mj„{n), where J' = (1,0) + SW„_i and J" = {(i,l) : 
2 < i < n} U {(n, 2)}. By [H Remark 1], we can assume that S is 
unitary. As J = (J')^ U J", we deduce that SAS"'^ G Mj(n). Hence J 
is n-universal. D 

3. Nonsingular patterns 

Before defining the singular and nonsingular patterns we introduce 
some preliminary notions. 

Let R[a;i, X2, . . .] resp. Rfx^*^^, x^^, . . .] be the polynomial ring resp. 
Laurent polynomial ring in countably many commuting independent 
variables Xi,X2,..- over R. We introduce an inner product, (.,.), in 
R[x^\xf^, . . .] by declaring that the basis consisting of the Laurent 
monomials is orthonormal. We also introduce the involution / — > /* 
and the shift endomorphism r of this Laurent polynomial ring where, 
by definition, 

/ [Xl, X2, ■ ■ ■) = f{Xi ,X2 , . . .) 
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and T{xi) = Xi^i for all i > 1. For any Laurent polynomial /, we 
denote by CT{/} the constant term of /. It is easy to see that for 
/, (7 G R[a;;^ ^,X2^, ■ ■ ■] we have 

{f,g) = CT{r9} = CT{fg*}. 

We shall denote by di the partial derivative with respect to the vari- 
able Xi. For any / G R[xi, 0:2, . . .] we set 

df = f{d,,d2,...). 

To each pattern I we associate the polynomial 

x/ = n i^i-^j)^ 

(*j)e/ 
and the differential operator 

9i=d^j = n i^^-^j)- 

Next we introduce special notation for certain symmetric polynomi- 
als in the first n variables Xi, 0:2, . . . , a;„: 

(o.ij O'k^n = / J Xi^Xi^ ■ ■ ■ Xj^, K G |U, i, . . . , n\^ 

for the elementary symmetric functions, and 

(3.2) hu,n= Yl 4'4'---4", A;G{0,l,...,n}, 

diA \-d„=k 

for the complete symmetric functions. 

We denote by H{n) the quotient of R[a;i, X2, ■ ■ ■ , a;„] modulo the ideal 
IC{n) generated by the ak^n, k G Z„, and define (/?„ : R[xi, X2, • • • , x„] -^ 
7i{n) to be the natural homomorphism. 

Definition 3.1. We say that I E Vn is n-singular if ^n{xi) = 0? ^"^^ 
otherwise that it is n-nonsingular. We say that / G P^ is n- exceptional 
if it is n-singular but not n-defective. 

Note that if a pattern / contains a diagonal position then x/ = (in 
particular, I is singular). 

Lemma 3.2. Every n-nonsingular pattern is also m-nonsingular for 
all m > n. 

Proof. Let I E Vn he m-singular for some m > n. Then there exist 
polynomials fk G R[a;i, X2, . . . , Xm] such that 

m 

Xl{Xi,X2, . . . , X„) = ^ fk{xi,X2, . . . , Xm)(rk,m{Xi,X2, . . . , Xm)- 
k=l 
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By setting x„+i = ■ ■ ■ = x^ = 0, we see that / is n-singular. D 

We remark that the converse of this lemma is not vahd. (All seven 
patterns listed in Table 2 of Section [7] are counter-examples for n = 4.) 
To simplify the notation, we set 

l<i<j<n 

Its expansion is given by the well known formula 

n 

(3.3) Xn=5^sgn(a)n<«- 

Consequently, we have {Xn,Xn) = n\. 

The following result (see [H Proposition 2.3]) provides a practical 
method for deciding whether a pattern is nonsingular. In particular, it 
implies that NE„ is nonsingular. 

Proposition 3.3. A pattern I &V'^ is n-singular iff {xi, Xn) = 0. 

We now state two problems concerning the inner product in this 
proposition. 

Problem 3.4. Is it true that {xi, Xn) ^ ""-' ioi all I E Vn and that 
equality holds iff Xi = Xn^ 

Problem 3.5. Is it true that {xi,Xi) ^ ^^- fo^^ ^-H -^ ^ ^n ^^^1 that 
equality holds iff xi = iXn? 

The computations carried out for n < 5 show that, in these cases, 
the answer is affirmative for both problems. 
In connection with Theorem 12.71 we propose 

Conjecture 3.6. Let Jk^n ^ 'P'n! ^ ^ Z„_i, be the union of the translate 
(0, 1) + NE„„i, the product {n} x Zk, and {{i, 1) : k < i < n}. Then 

^n\ (n — 2^ 



\XJfc,„5 Xn) — \ -Lj \ u \ \h _ \ 

The assertion in the case k = \ will be proved in Example 16. 3[ The 
universality of J^^n "was proved in Theorem 12. 7[ The conjecture has 
been verified for n < 10 and all k G Z„_i, except for (n, fc) = (10, 5) in 
which case our program ran out of memory. 

We say that a pattern I is simply laced, or just simple, if / fl /^ = 0, 
and otherwise we say that I is doubly laced. In particular, a simple 
pattern is strict. Any simple pattern I E Vn can be extended to a 
simple pattern I' E V!^. As xi divides xi' cind xi' = ^Xn, any simple 
pattern is nonsingular. 
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The following two results are extracted from Proposition 4.3 and 
Theorem 4.2 of our paper [T]. 

Proposition 3.7. Every nonsingular pattern I E Vn can be extended 
to a nonsingular pattern I' eV^. 

Theorem 3.8. (Generalization of Schur's triangularization theorem) 
Every nonsingular pattern in Vn is n-universal. In particular, every 
simple pattern in Vn is n-universal 

In connection with these results we pose an open problem. 

Problem 3.9. Let J be a strict n-universal pattern. Does / extend to 
a strict ra- universal pattern of size /i„? 



If we replace the word "strict" with "proper" then Proposition | 
shows that the answer is negative. 

A special case of the general inner product identity that we prove in 
the next theorem will be used in the proof of the subsequent proposi- 
tion. 

Theorem 3.10. Let G be a connected compact Lie group, T a maximal 
torus with Lie algebra i and W the Weyl group. Denote by /i be the 
number of positive roots and by x their product. Let A = Q)n>o-^n be the 
algebra of polynomial functions t ^ R with the degree gradation, and 
let (-, ■) be a W -invariant inner product on A. If h E A is W -invariant, 
then 



\x\?{hf,hx) = \\hxr{f,x). ^feA 



v-- 



Proof. We may assume that h y^ 0. For the linear functional L : A^ —>■ 
R defined by L{f) = {hf, hx), we have a ■ L = sgn(cr)L for all a G W . 
There is a unique g G A^ such that L{f) = {f,g) for all / G Afj_. 
Moreover, a ■ g = sgn{a)g for all a G W. As the sign representation of 
W occurs only once in Afj,, we must have g = ex for some c G R. The 
equality L{x) = (x? ex) completes the proof. D 



The next proposition, a nonsingular analogue of Proposition 12. 5[ 
shows that some extensions of nonsingular patterns are nonsingular. 
In a weaker form, it was originally conjectured by Jiu-Kang Yu. 

Proposition 3.11. For I G V^, J G V'^_n, m> n, and 
r = IU ((n, n) + J)U ((0, n) + Z, X Z„_„) 
we have 

{Xl',Xm)= {j{Xl,Xn){X.J,Xm-n)- 
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Proof. We apply the above theorem to the case where G = U(n) x 
U(m — n). Then the algebra A can be identified with the polynomial 
algebra R[a;i, . . . , Xm] so that R[a;i, . . . , a:„] resp. R[x„+i, . . . , Xm] is 
the corresponding algebra for U(n) resp. U{m — n). The polynomial x 
factorizes as x = Xn ■ T^Xm-n, where r is the shift operator. We take 
f = Xi ' t"Xj and for h we take the polynomial 

n m 

n n (^i-^i)' 

j=l j=n+l 

which is obviously invariant under W = Sn ^ Sm-n- Since hx = Xm 
and hf = xi', the theorem gives the identity 

\\xf{Xl',Xm) = llXmf (/,X)- 

Since ||xP = n\{m — n)!, ||/?.x|P = ||Xm|P = ""^'j and 

iXl ■ ^"XJ, Xn ■ r'^Xm-n) = {XU Xn) (XJ, Xm-n) , 

the assertion follows. D 

4. Equivalence and weak equivalence 

The symmetric group Sn acts on Vn by a{I) = {(o"(«), o-{j)) '■ (hj) G 
J} for a G S'„. For a E Sn and I EVn^e have o" ■ X/ = Xo-(/)- As "P^ is 
S'„-invariant, we obtain an action on V'^- We denote by Sn the group of 
transformations of V'n generated by the action of Sn and the restriction 
of transposition T to V'n- (Note that this restriction commutes with 
the action of S'„.) As the inner product is S'„-invariant, we have 

(Xa(/),Xn) = (X/,0--Xn) =Sgn(0-)(x/,Xn), I ^ V'n, (T E Sn- 

We say that the patterns /, /' G V^ are equivalent if they belong to 
the same orbit of Sn- If so, we shall write / ~ /'. We denote by [I] the 
equivalence class of / G P^. 

Assume that / ~ /'. It is easy to see that /' is universal iff I is 
universal. Since kenpn is invariant under permutations of the variables 
Xi,X2, ■ ■ ■ ,Xn, ^e deduce that I' is nonsingular iff / is nonsingular. We 
say that the class [J] is singular, nonsingular, universal, defective or 
exceptional if I has the same property. These terms are clearly well 
defined. 

Let / G P be any pattern and let us fix a position {i,j) G / such that 
(j, i) ^ /. Denote by /' the pattern obtained from / by replacing the 
position {i,j) with {j,i). We shall refer to the transformation I ^ I' 
as a flip. 
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Problem 4.1. Let I E V'^ he n- universal and let / — > /' be a flip. Is 
it true that /' is n-universal? 

We say that the patterns 1,1' ^Vn are weakly equivalent if / can be 
transformed to /' by using flips and the action of Sn- If so, we shall 
write I r^ I'. We denote by [J]^ the weak equivalence class of / G P„. 
As the transposition map Vn — > Vn can be realized by a sequence of 
flips, we have [I] C [J]^ for all I E Vn- Note that the nonsingularity 
property is preserved by weak equivalence. 

Let us deflne the complexity, i^{I), of a pattern / as the number of 
positions {i,j) E I H I^ with i < j. The patterns of complexity 
are precisely the simple patterns. Observe that a pattern I E V'^ has 
complexity 1 iff there exist a unique 2-element subset {i,j} C Z„ such 
that {i,j) and {j,i) belong to /. Similarly, I E V'^ has complexity 1 
iff there exist a unique 2-element subset {k,l} C Z„ such that neither 
{k, I) nor (/, k) is in I. 

It is natural to ask which patterns / E V'^ of complexity 1 are univer- 
sal or nonsingular. We shall now give a complete answer to the latter 
question. At the same time we classify, up to weak equivalence, the 
patterns in V'^ having complexity 1. 

Theorem 4.2. Let I E V^, ^{I) = 1, and let {i,j} resp. {k,l} 
be the unique 2-element subset of Zn such that {i,j),{j,i) E I resp. 
{k,l),{l,k)il. 

(a) Ifi,j,k,l are not distinct then 

/~(NE„\{(1,2)})U{(3,1)}, n>3, 

and we have {xi, Xn) = ± n\/2. 

(b) Ifi,j,k,l are distinct then I is singular and 

/~(NE„\{(1,2)})U{(4,3)}, n>4. 

Proof, (a) We have, say, i = k. Let J = cr(/), where a E Sn is chosen 
so that (j{i) = 1, a{j) = 3 and cr(/) = 2. For each (r, s) E J with 
r > s and (r, s) ^ (3, 1) we apply a flip to replace (r, s) with (s, r). We 
obtain the desired pattern. Proposition 13.111 gives the formula for the 
inner product. 

(b) The equivalence assertion is proved in the same manner as in (a) 
and, since this new pattern is defective, I must be singular. D 

We conclude this section by providing some numerical data about 
the equivalence classes in P^ for 2 < n < 5. For each n. Table 1 
gives the cardinality of V'n, the number of equivalence classes, and the 
number of nonsingular, defective, and exceptional classes in that order. 
The last column records the number of weak equivalence classes. 
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Table 1: Equivalence classes 

n YPn\ Equ. Nons. Def. Exc. Weak 



2 2 110 1 

3 20 3 3 2 

4 928 30 19 4 7 12 

5 184956 880 619 66 195 110 

For any n we have \V'^\ = (^^") , but a formula for the number of (weak) 
equivalence classes is not known. 

Problem 4.3. Find a formula for the number of (weak) equivalence 
classes in V'. 



5. An ANALOGUE OF SCHUR'S THEOREM 

Recall the patterns A„ G P^j ""- — Ij defined in the Introduction. 
The zero entries required by A„ for n = 2, 3, . . . , 7 are exhibited below: 



* 







* 





* 








* 





* 


* 





* 


* 





* 


* 


* 



* * 
0*00 
0** 

* * * 
* * * 



* * 
0*000 
0*0* 
* * * 

* * * * 
* * * * 





* 
* 
* 
* 
* 



* * 
0*0000* 
0*00** 
* * * * * 
* * * * 

* * * * * * 
***** * 



The maximum of v{I) over all / G P^ is [/x„/2]. Let us write n = 4m+r 
where m is a nonnegative integer and r G {0, 1, 2, 3}. Note that A„ is 
symmetric for r G {0, 1}, and otherwise there is a unique {i,j) G A„, 
namely {2m + 1,2m + 2), such that {j,i) ^ A„. Hence A„ has the 
maximal complexity [/i„/2]. Our objective in this section is to prove 
that A„ is nonsingular. As A„ is a (necessary) minor modification of 
the triangular pattern NW„, we consider this result as an analogue of 
Schur's theorem. 
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Theorem 5.1. We have {xA„,Xn) = (— 1)*?t-!/2*, where s = [(n+l)/4]. 
In particular, A„ is universal. 

For the proof we need four lemmas and the foUowing three facts 
which foUow immediately from [3, Chapter III, Lemma 3.9]: 
(i) x^ G /C(n) for k > n, 1 < i < n; 
(ii) li f,g E R[xi, X2, ■ ■ ■ , Xn] and f = g (mod /C(n)) then 

(5.1) dfXn = dgXn] 
(iii) If / G R[xi, X2, . . . , x„]^„ then 

n-l 

(5.2) dfXn = X{k\-{f,Xn). 

k=l 

By diferentiating the formula (13.21) . we obtain that 

(5.3) dihk,n= Yl {l + d^)xi'xi'■■■x't, i<n. 

d\-\ \-dn=k—l 

We prove first the following congruence. 
Lemma 5.2. For l<r<m<nwe have 

Y\ (Xr - Xi) = drhn-m+l,m (mod }C{n)). 
m<i<n 

Proof. Without any loss of generality we may assume that r = 1. Let 
s, t be two additional commuting indeterminates. Observe that for any 
polynomial /(t), with coefficients in R[xi, . . . ,x„], the constant term 
of 

when expanded into a formal Laurent series with respect to s, is equal 
to f{t). For 

f{t) = {t-Xi)- J] [t-Xi) 
m<i<n 

we have 



F{s,t) 



,n-m+i(i_,t)n::,(i-sx,) 

^ n 00 

„_^+l • ^(-S) Vfe,„ ■ Y^ hi^^{t, X2,..., x„)s'. 



fc=0 1=0 

Hence 

n—m+l 



f{t)— 2_^ \'^) '^k,nhn-m+l-k,m.{t,X2, ■ ■ ■ ,Xm)- 



k=0 
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By evaluating the partial derivative with respect to t at the point t = 
Xi, we obtain that 

n—m+l 

Y\ {Xi-Xi)= ^ {-l)''crk,ndlhn-m+l-k,rn{Xi,X2,...,Xm) 
m<i<n k=0 

and the assertion of the lemma follows. D 

Recall the endomorphism r defined in the beginning of Section [31 
Lemma 5.3. For P = dih2,n-i{xi,Xn), i-c, 

n-2 

P = J2{n - 1 - k)x'l'^~''x'^, n > 4, 

fc=0 

we have 

(5.4) dlxn = {-irn\{n - 2)! ( ^^Xi + ^^a;„ -J^xA rXn-2. 

Proof. Since x",a;J^ G /C(ra), we have 

p2 = ax^-^xl'^ + hx^-^xl-^ + cxl-^xl~\ (mod /C(n)), 
where 



n-2 

a = 
fc=i 

n-l 



^ A;(n - 1 - fc) = n(n - l)(n - 2)/6, 
fc=i 

n-l 

6 = >^ k(n — k) = n{n — l){n + l)/6, 
fc=i 

n-l 

c = ^ fc(n + 1 - A;) = n(n + 5)(n - 2)/6. 



fc=2 

By using the property (15. ip . we obtain that 

If we omit from Xn the terms ±X;^^ ■ ■ ■ x^" with di + dn < 2n — 4, we 
obtain the polynomial (— l)"<5TXn-2 where 

n-l 

n — |'t-"-1^"-2 _ n-2 n-l\ _ / n-l n-3 _ n-3 n-l\ V^ 

^/ — I^X^ X„ Xi X„ ; I^X;^ X„ Xi X„ ) 2_^Xk- 

k=2 
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Since the omitted terms are killed by dp, we have dpXn = (— l)"C'TXn-2 
where 

n-l 

C = (n-l)! {n - 2y.{{b - a)xi + [c - b)xn) - {n - 3)\{c - a)^Xk 

k=2 

It remains to plug in the values oi a,b and c. D 

The next lemma gives another important identity. 

Lemma 5.4. Let Jn = J^U (Jn)'^ , n > A, where J^ is the union of 
{(l,2),(l,n-l),(2,n)} and {1,2} x {3,4, . . . , n - 2}. Then 

dj^Xn = \n\{n - l)!(n - 2)\{n - 3)\t'x^.^. 

Proof. By using Lemma 15.21 we obtain the congruence 



2 



(n-l \ / "-"^ 

JJ(xi-Xi)J I (a;2-a;„) JJ(x2-Xi 
j=2 / \ j=3 

= -P^R^ (mod/C(n)), 
where P is defined as in the previous lemma and 

R = d2hn-2fi{Xl,X2, X„__i) = ^ (1 + (^2 ) X ^ ' ^3^ X^l ^ . 

di+d2+d-i=n—Z 

In view of the formula (15.41) . it suffices to prove that 

(5.5) dlF = ^-^—{n - mn - 3)!r^Xn-4, 

where 

n — 1 n — 3 -^-^ \ 

^— a;i H ^Xn - 2_^Xk\ TXn-2- 

k=2 J 

Since deg(i?^) = 2n — 6, we need only consider the terms in F for 
which the sum of the exponents of xi, X2 and x„_i is at least 2n — 6. 
Their sum is 

77 — 1 

F' = (-l)"(^-xi -X2~ x^^,){xr'xlzl - xr^xr?)r\„-4. 

Note also that the exponents of Xi in F' are < 1. So we need only 
consider the terms in d]^ for which the exponent of (9i is or 1. Their 
sum is Df + 2diDiD2 where 

71 — 3 

D, = Y,{n-2-k)dr'-'dt^„ 

fc=0 
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n-4 



fc=0 

After expanding the products -D1-D2 and D\: 






the exhibited coefficients can be easily computed: 

n— 3 



ai = ^A;(n-l-fc) = (n-2)(n-3)(n + 2)/6, 

k=l 

71-2 

a2 = ^A;(n- A;) = (n-l)(n-3)(n + 4)/6, 

fe=2 
n— 3 

hi = h2 = ^k{n-2-k) = {n-l){n-2){n-3)/6. 

k=l 

Thus 

D.D^ixr'xlzt-xr'x^Zl) = (n-3)!(n-4)!(ai-6i) 

= (n-2)!(n-3)!/2, 

Dlixr'xlzt-xr'x^zl) = {n - 2)\{n - A)\{a2 - h) 

= (n-l)!(n-3)!. 

Hence 

dlF = {Dl + 2diD^D2)F' 

= i-ir [in - l)D,D,{xr'xlz\ - xr'xlzl) 

—U^[X2 X^_-^ ~ X2 X^_-^^)^ T Xn-45 

which completes the proof. D 

The fourth lemma follows easily from the previous one. 

Lemma 5.5. Let I = JnU ((2, 2) + /'), n > 4, where Jn is defined as 
in the previous lemma and I' G 7^4-4 ^-^ arbitrary. Then 

(XhXn) = -n{n-l){n-2){n-3){xi',Xn-4)- 
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Proof. Since xi = Xj„^^X/', we have dj = (9j„9^2^^,. By using ([OD 
and Lemma 15.41 we obtain that 



{Xl,Xn) 



n(n-l){n-2){n-3y{di>Xn-4) 

mrJki 

-n{n - 1) (n - 2) (n - 3) {xr , Xn-i) ■ 



D 



We can now prove the theorem itself. 

Proof. We construct the patterns A^ inductively as Aq = A'^ = 0, 
A'2 = {(1, 2)}, A^ = {(2, 1), (2, 3), (3, 2)}, and K = JnU ((2, 2) + A'„„J 
for ra > 4. We claim that (xa;^, Xn) = n\/2^. 

We prove the claim by induction on n. It is straightforward to verify 
the claim for n = 0,1, 2, 3. For n > 4, by Lemma [531 and the induction 
hypothesis, we have 

{XK,Xn) = -n{n-l){n-2){n~3){xA'^^^,Xn~4) 

1 (n — 4V n^ 
= -n(n-l)(n-2)(n-3)-^ — f^ = -. 

2 2'^ 2'^ 

It remains to observe that ct(A^) = A„, where 



a = Y[{2k-l,2k) G Sn- 



k=l 



D 



6. A REMARKABLE FAMILY OF NONSINGULAR PATTERNS 



It is a challenging problem to construct an infinite family of new 
nonsingular doubly laced patterns. The main result of this section 
gives a construction of such a family. It includes, as a special case, a 
new analogue of Schur's theorem namely another modification of the 
triangular pattern NW^ (see Proposition 16. 4p . 

We first introduce the notation that we need to state and prove our 
theorem. Let a & Sn and let r = (ri, r2, . . . , r^-i) be a sequence with 
Tfc G cr(Zfc) for all k G Z„_i. For k G Z„_i we set 

h = {irk,a{j)) ■.k<j<n}. 

As usual, 6ij will denote the Kronecker delta symbol. 
The main technical tool is the following lemma. 
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Lemma 6.1. Under the above hypotheses, for < m < n we have 
di.di,, ■ ■ ■ di^Xn = 

Sgn(cT) I JJ(n -k + (5r^,a(fe))! j Xn-m{Xa{m+l), ■ ■ • ,2;^(n))- 

Proof. We use induction on m. The assertion obviously holds for m = 
0. Assume that m > 0. By the induction hypothesis we have 

di.di, ■ ■ ■ di^Xn = 

JJ(n - A; + (5rfc,<7{fc))! j ■ di^Xn~m+l{x„^^), . . . ,X^(„)). 

By Lemma [5.21 we have 

Xlm = n (^'''" ~^'^(i)) 

m<i<n 

= dr^ hn-m+i,m (x^(i) , . . . , x^(m) ) (mod AC (n) ) . 
By invoking the property (15.11) and the identity (15. 2p . we deduce that 

^ImXn—m+l\X(T{m)i ■ ■ ■ iXo-(n)) 

/ , (1 + ^''„)f^CT(i) ■ ■ ■f^^^)Xn-m+l(a^a(m), • • • ,Xa{n))- 

(iiH \-dm='n-—m 

All terms in this sum vanish except the one for di = ■ ■ ■ = dm-i = 
and dm = n — m. We infer that 

(1 + (n - m)(5r„,^(^)) d2^^^Xn~m+l{Xa{m), ■ ■ -^X^^n))- 

Since 

we are done. D 

Let us fix a permutation a E Sn and let i = (ii, Z2, • • • ,'^n-i) be a 
sequence of distinct integers such that \ik\ G o"(Zfc) for all k G Z„_i. 
Next we set 

1 (cr(j), — ife) otherwise. 
With these data at hand, we construct the strict pattern 
(6.1) J{a, i) = {(zfc, a(j))+ : 1 < fc < J < n}. 



T )l 

1 
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We claim that the conditions imposed on i imply that the map send- 
ing {kj) -^ (zfc,o-(j))+ for k < j is injective, i.e., that \J{cr,i)\ = /i„. 
Indeed, assume that two different pairs {k,j) and (r, s), with k < j and 
r < s, have the same image, i.e., (ifc,cr(j))+ = (v,o"(s))+. Clearly, we 
must have k ^ r and ikir < 0. Say, k < r. Then \ik\ = o"(s) ^ o"(Z 
which contradicts the condition \ik\ G o"(Zfc). This proves our claim 
and so we have J{a, i) G V'^- 

Let i7„ C P^ be the set of all patterns J {a, i). For any n, let t G S'„ 
be the identity permutation. There are exactly (n!)^ choices for the 
ordered pairs (cr, i). However the corresponding patterns J(a", i) are 
not all distinct. For instance, if n = 2 we have J(cr, (2)) = J{l, (— 1)) 
with a = (1,2). 

The following is the main result of this section. 

Theorem 6.2. For J = J{a, i) we have 

{XJ,Xn) = i-lfsgn{a) n [n-k + l), 



k:\ik\=r^ik) 



where 



d = 2. (tl — k). 

Proof. We apply the lemma with r = (|ii|, |i2|, • • • , Kn-i|) and m = 
n — 1. Thus we now have Ik = {(|4|,cr(j)) '■ k < j < n} for all 
k G Zn-i- Since Xi = 1, the lemma gives 

n.-l 

di.di^ ■ ■ ■ di„_,Xn = sgn(or) JJ(n - A; + (5|i,|,a(fe))!- 

fc=i 

By (15. 2p we have 

n-l 
dl.dl^ ■ ■ ■ dl^_,Xn = n*^^ ~ ^)' ■ (XhXh ■ ■ ■ Xl„-i,Xn)- 

fe=i 
Observe that J is the disjoint union of the /^'s with i^ > and the 
Jj's with ik < 0. Therefore we have xj = (~l)"'x/iX/2 ' ' ' Xi„-i and 
the assertion follows. D 

Let us give an example. 

Example 6.3. Let n > 1 and let a G Sn be the identity. We set 
Zi = —1 and ik = k ~ 1 for 1 < k < n. The z^'s are distinct and the 
condition \ik\ G Z^ is satisfied for all k. In this case we obtain the 
pattern 

J = {(i, j) :l<i<j-l<n-l}U {(i, l):l<i<n}. 
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Only ii is negative and so d 



n 



1, and \ik\ 



for k = 1. By the theorem we have {xj, Xn) 
the case fc = 1 of Conjecture | 



(j{k) = A; is vahd only 
(— l)"~-'^n. This proves 



Recall that NW„ is not n-universal for ra > 3 (see Example I2.2p . 
However, if we modify this pattern to make it strict by replacing its 
diagonal positions (z, i) with (z, ra + 1 — i), we can show that the new 
pattern 



n. 



{{hi) ■■i + j<n,i ^ j}U{{i,n-i + 1) : 2i < n} 



is nonsingular and, consequently, universal. This is our second analogue 
of Schur's theorem. The zero entries required by n„ for n = 2,3,4,5 
are exhibited below: 
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* * 


* 
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* 


* 
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* 


* 


* 


* 



Proposition 6.4. We have {xn„,Xn) 



n\\. 



Proof. This is in fact a special case of Theorem 16. 2[ We take a G S'.„ to 
be the permutation l,n, 2,n — 1, . . . . Thus a{2k — l) = k for 2k — l<n 
and a{2k) = n + 1 - k hr 2k < n. We set i = (1, -1, 2, -2, . . .). The 
ifc's are distinct. As i2k-i = —hk = k = a{2k — 1), the condition 
\ik\ G o"(Zfc) is satisfied for all fc's. With this a and i we have n„ = 
J(cr, i). The equality \ik\ = cr{k) holds iff k is odd and the inequality 
ifc < holds iff k is even. Thus d = 'Y^{n — 2k), the sum being over 
all positive integers k such that 2k < n. Therefore d is even for n 
even and d = ['n/2] (mod 2) for n odd. One can easily verify that 
sgn(o") = (—1)'' in all cases. Hence, we obtain the formula given in the 
proposition. D 

In several cases we used [7] to identify various sequences that we 
have encountered, such as the double factorial sequence ^4006882 in 
the above proposition. 

Let J = J(a, i) be the pattern (16. ip . Note that J^ = J(cr, — i), 
where — i = (— ii, —22, • • • , —in-i)- If p G S'„ it is easy to verify that 
p{J) = J(p(T,j) where j : 



/1,J2, 



,Jn-l. 



with 



Jk 



p{ik) if ik > 0; 

-p{—ik) otherwise. 

It follows that J'n is a union of equivalence classes. 
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Determine the number of equivalence classes contained 



For n = 2, 3, 4, 5 the answers are 1, 2, 7, 34 respectively. 

In the case when o = i, the sequence i = (zi, Z2, . . . , ^n-i) is subject 
only to the conditions: (a) the integers i^ are pairwise distinct and 
(b) ifc G Zfc for all k G Z„_i. In particular i^ = ±1. To simplify 
the notation, in this case we set J(i) = J(i, i). From the previous 
discussion it is clear that each equivalence class contained in J7„ has a 
representative of the form J(i) with ii = 1. However, J(i) ^ J(j) may 
hold for two different sequences i and j with ii = ji = 1. For instance, 
forn = 3 we have J((l, 2)) ^ J((l, -2)). 

7. The case n = A 

In this section we fix n = 4. Recall that the nonsingular patterns 
are universal, and the defective ones are not. In this section we shall 
exhibit a strict pattern which is singular and universal (see Proposition 
17.31 below). There are 7 exceptional equivalence classes in V'^^, their 
representatives are listed in Table 2. The last column of the table 
shows what is known about the universality of the pattern. 

Table 2: Exceptional classes for n = 4 

No. Representative pattern Univ. 



1 


{(1,2) 


(2,1) 


(1,3),(3,1),(2,3),(3,2)} 


No 


2 


{(1,2) 


(2,1) 


(1,3),(1,4),(2,4),(3,2)} 


No 


3 


{(1,2) 


(1,3) 


(1,4),(2,1),(3,4),(4,3)} 


Yes 


4 


{(1,2) 


(2,1) 


(1,3),(3,1),(2,4),(4,3)} 


? 


5 


{(1,2) 


(2,1) 


(1,3),(2,3),(4,1),(4,2)} 


? 


6 


{(1,2) 


(2,1) 


(1,4),(2,3),(3,1),(4,2)} 


? 


7 


{(1,2) 


(2,1) 


(1,4),(3,1),(3,4),(4,3)} 


? 



We shall prove now that the first two patterns are not universal. 

Proposition 7.1. The first pattern in Table 2 is not universal. 

Proof. Denote this pattern by /. Let A G -^(4) be the matrix whose 
entries in positions (1,2) and (3,4) are 1 and all other entries are 0. 
Note that A has rank 2 and that A^ = 0. Assume that A is unitarily 
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similar to some X = [xij] G L/. Thus X has the form 



* 








* 





* 





* 








* 


* 


* 


* 


* 


* 



X 



Since X must be nilpotent of rank 2, it is clear that at least one of X14, 
2^24, 2:34 is nonzero, and also at least one of X41, X42, X43 is nonzero. We 
may assume that 0:14 7^ 0. Then X^ = implies that 0:42 = 0:43 = 0, 
and so X41 7^ 0. As X22 and 0:33 are eigenvalues of X, we must have 
2^22 = 2:33 = 0. From X^ = we deduce that 0:24 = X34 = 0. Thus only 
the four corner entries of X may be nonzero. As X is nilpotent of rank 
2, we have a contradiction. D 

Proposition 7.2. The second pattern in Table 2 is not universal. 



Proof. Denote this pattern by / and let 



A 















—i 


-i 





-1 


1 1-i 


1 


2 


i-1 



a nilpotent matrix of rank 3. Assume that AU = UX for some X 
[xij] G Li and some U = [uij] G U(4). Thus X has the form 



* 














* 


* 





* 





* 


* 


* 


* 


* 


* 



X 



Let Uk denote the k-th column of U. By equating the entries in X = 
U*AU, we obtain that Xij = u*Auj for all i, j. 

Since X is nilpotent, we must have xu = 0. The first row of X is 
zero, and the other three rows must be linearly independent because X 
has rank 3. Since the first row of UX = AU is zero, we conclude that 
■U12 = ^13 = Mi4 = 0. As f/ is unitary, we also have U21 = u^i = M41 = 0. 
Without any loss of generality, we may assume that Un = 1. 

Since u^Aui = x^x = 0, we have U42 = 0. 

Assume that M32 = 0. Then M23 = ^24 = 0, and we may assume that 
■U22 = 1- Since ulAu2 = X32 = 0, we obtain that —^33 + 2-U43 = 0. 
Since U3 _L u^, we must have ^44 = —2us4 7^ 0. Now we obtain a 
contradiction: = X24 = U2AU4 = —ius^. 

Thus we must have ^32 7^ 0. Then U2 = 1^32(0, ,^, 1, 0) with ^ = 
U22/u32- If M24 = 0, then U2 J- U4 implies that ^34 = and the condition 



26 



J. AN AND D.Z. BOKOVIC 



X2i = again gives a contradiction. Consequently, we must have M24 7^ 
and so ti4 = ^24(0, 1, — ^, f]) for some r/ G C. Then we have 

AU2 = 1X32(0,-^(1+0,1-^,20, 

Au^ = u24(0,^(e-l),-l-^+(l-0r/,2 + (^-l)r/). 

As we must have Au4^ -L M2, we obtain that 

(7.1) ,^(i_^)_(i + ^) + (i + ,)^ = 0. 

Since U*Au2 is the second column of X, Au2 must be a linear combi- 
nation of U2 and M4. Therefore 

e -^(1 + 1 

1 1-e -e 

2e r/ 

I.e., 

(7.2) 7^(01 - + ^(1 + 0) + 201 + i^n = 0. 

From fl7.1j) and fl7.2p we obtain that 

Oi-0 + ^(i + = (^-i)^, 

{l-i)\r]\ 



'2 -201 + 10') 



Hence, ^ = A(l — i) for some real A > 0. 
It follows that 



1^1 
[i - l)f] 

2kr 





2A(1 + 2A2), 
i + 2A + 2iA^ 
4A^ + SA^ + 1, 



1-2A + 2A 



2\2 



which is a contradiction. 



D 



We now give the promised example of a pattern which is universal 
and singular. 

Proposition 7.3. The third pattern in Table 2 is universal. 

Proof. Let A be any linear operator on C^ of trace 0. We have to 
construct an orthogonal basis {ai, a2, as, 04} such that, with respect to 
this new basis, the matrix of A belongs to Lj. 

For ai we choose an eigenvector of A* . The case when ai is also an 
eigenvector of A is easy and we leave it to the reader. We extend {oi} 
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to an orthogonal basis {ai, bi, 62, ^3} such that Aai = Xai + 63 for some 
A G C. The matrix of A with respect to this new basis has the form 



" A 


000" 










B 


1 





In order to complete the proof, it suffices to show that there exist 
nonzero vectors x,y E aj^ such that 

(7.3) Ax -L y, x -L Ay, x -L y, 63 G spanjx,?/}. 

We shall now work with the A-invariant subspace a-^;. Let bij, i,j G 
{1,2,3} be the entries of the submatrix B. We may assume that 
^31^23 7^ ^32^13 because such matrices form a dense open subset of 
M(3). We shall write vectors in aj- by using their coordinates with 
respect to the basis {&i,&2,&3}- We shall seek the vectors x and y in 
the form 

X = {a + ib, c + id, 1) , y = (a + ib, c + id, —a^ ~ b^ — c^ — d^), 

where a,b,c,d G R. Observe that the last two conditions in fl7.3p are 
automatically satisfied. The first two conditions give 

(7.4) (611 (a + ib) + 612(0 + id) + b^) (a - ib) + 
(621(0 + ib) + 622(0 + id) + 623) (c - id) - 

(631 (a + ib) + 632(0 + id) + 633) (a^ + b^ + c^ + d^) = 
and 

(7.5) (6ii(a + ib) + 612(0 + id) - 613(0^ + 6^ + c^ + rf^)) (a - ib) + 

(621(0 + ib) + 622(0 + id) - 623(0^ + 6^ + 0^ + d^)) (c - id) + 

(631(0 + ib) + 632(0 + id) - b33{a^ + b^ + c^ + d^)) -1 = 0. 

By taking the difference and cancelling the factor 1 + a^ + 6^ + c^ + c?^, 
we obtain the linear equation 

(7.6) 613(0 - ib) + 623(0 - id) - 631(0 + ib) - 632(0 + id) = 0. 

Thus our problem is reduced to showing that the equations (17.41) 
and (17. 6p have a real solution for the unknowns a, 6, 0, d. We now set 
Ki + ^^i'l where b[,,b'-, G R and denote by (5*) the system of 



^ij 



four equations obtained from (17.41) and (17. 6p by equating to zero their 
real and imaginary parts. The first two of these four equations are 
not homogeneous. By homogenizing these two equations we obtain 
the system which we denote by (S"). Although we are interested in 
real solutions, we shall now consider all complex solutions of (S") in 
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the complex projective 4-space. By Bezout's theorem, there are 9 so- 
lutions in the generic case (counting multiplicities). We are going to 
show that exactly two of these solutions lie on the hyperplane at in- 
finity. Consequently, the system (S) has exactly 7 solutions (counting 
multiplicities). Since the non-real solutions come in complex conjugate 
pairs, at least one of them has to be real. Clearly, this will complete 
the proof. 

To find the solutions in the hyperplane at infinity (a complex projec- 
tive 3-space), we have to solve yet another homogeneous system, (S"'), 
which is obtained from (S) by omitting the terms of degree less than 3 
in the first two equations and retaining the last two (linear) equations. 
The two new cubic equations factorize as follows: 

(a^ + b^ + c^ + d^){h'^^a - hl^h + h'^^c - hl^d) = 0, 
(a^ + b^ + c^ + (f){hl^a + h'^^h + hl^c + h'^^d) = 0. 

If we assume that a^ + b"^ + c^ + d"^ ^ 0, then we obtain a system of 
four linear equations. The condition 631623 7^ 632613 is just saying that 
the determinant of this system of linear equations is not 0. Thus, this 
system has only the trivial solution. Hence the solutions of {S") are 
just the solutions of the system of two linear equations of (S) and the 
equation a^ + 6^ + c^ + rf^ = 0. But a line intersects a quadric in exactly 
two points and we are done. D 

For the remaining four exceptional classes the universality remains 
undecided. 

Problem 7.4. Decide which of the last four patterns in Table 2 are 
universal. 

8. Counting reducing flags 

Recall that the homogeneous space JF„ = U(n)/T„ is known as the 
flag variety. It is a real smooth manifold of dimension n{n — 1). The 
points of this manifold can be interpreted in several ways. By the above 
definition, the points are cosets gTn, g G U(n). They can be viewed 
also as complete fiags 

= Vo C Vi C \/2 C ■ ■ ■ C K = C", 

i.e., the increasing sequence of complex subspaces Vk with dim\4 = k. 
We shall follow this practise and refer to the points of JF„ as flags. 
Yet another often used interpretation is to consider the points of JF„ as 
ordered n-tuples (Wi, W2, . . . , Wn) of 1-dimensional complex subspaces 
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of C" which are orthogonal to each other under the standard inner 
product. 

Let I E V'n and A G L{n). Assume that the orbit Oa meets L/ = 
Lj{n) and let Xa = Oa^Lj. The maximal torus T„ acts on Xa (on the 
right) by conjugation, i.e., {X,t) — > f^Xt where t E Tn and X G Xa- 
Let us also introduce the set 

l(A = {ge \J{n) : g-^Ag G Lj}, 

on which T„ acts by right multiplication. If g E Ua then g^^Ag G Li 
and we say that the flag gTn reduces Aio Li. Thus the set UA/Tn can 
be identified with the set of all reducing flags of the matrix A. 
The map 

(8.1) O-.Ua^Xa, e{g)=g-^Ag, 

is surjective and T„-equivariant. Our main objective in this section is 
to prove that the induced map 

(8.2) e : Ua/T^ ^ Xa/T^ 

is bijective, i.e., that we have a natural bijective correspondence be- 
tween the reducing flags (for A) and the T„-orbits in Xa- 

We need three lemmas. The first one is valid for any connected com- 
pact Lie group G. For any (? G G let Zg denote the identity component 
of the centralizer of (7 in G. 

Lemma 8.1. Let G he a connected compact Lie group and H a con- 
nected closed subgroup of maximal rank. For any g E G, g belongs to 
the center of Zg. If g E H then H contains the center of Zg. 

Proof. Let T be a maximal torus of G such that g E T. As T C Zg, we 
have g E Zg and the first assertion follows. If g E H, we may assume 
that T is chosen so that T C H. Then T is a maximal torus of Zg, and 
so T must contain the center of Zg. As T C H, we are done. D 

The next two lemmas deal with the case G = U(n). 

Lemma 8.2. If Hi and H2 are connected closed subgroups o/U(n) of 
rank n, then Hi fl H2 is connected. 

Proof. In view of the above lemma, it suffices to show that the center 
of Zg is connected for all g E U(n). To prove this, we may assume that 
(7 is a diagonal matrix. It follows that 

Zg = U(ni) X U(n2) x ■ ■ ■ x U(nfe), ni H \- Uk = n. 

Hence the center of Zg is a torus. D 

Lemma 8.3. The centralizer of any A E M{n) in U(n) is connected. 
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Proof. Let A = Ai + iA2 where Ai and A2 are hermitian matrices. 
Since A^ is unitarily diagonalizable, its centralizer H^ in U(?t,) is a 
closed connected subgroup of rank n. Hence, the centrahzer Hi fl H2 
of A in U(n) is connected by Lemma [8.2[ D 

We can now prove the desired result. Recall that A G L{n) is I- 
generic if Oa and Li intersect transversally. 

Theorem 8.4. Let I E V^ and let A G L{n) be I-generic. Then the 
map 6 defined by h8.1\) and h8.2^) is bijective. Consequently, Naj is the 
number of flags which reduce A to Lj. 

Proof. Since 6 is surjective, so is 6. In order to prove that 6 is injective, 
it suffices to show that ii gi, g2 G I^a are such that g^^Agi = g2^Ag2, we 
denote this matrix by B, then the element h = gi^g2 belongs to T„. If 
u(n) C M{n) is the space of skew-hermitian matrices, the transversality 
hypothesis implies that 

{X G u{n) : [X, B] G Lj} 

is the space t„ of the diagonal skew-hermitian matrices. Hence, the Lie 
algebra of the centralizer of B in U(n) is contained in t„. By the above 
lemma this centralizer is connected, and so must be contained in T„. 
As h commutes with B, we have h ETn- □ 

Remark 8.5. It follows from the theorem that the number Na,i coin- 
cides with the number denoted by N{A, Mj{n, C)) in [1]. 

9. The cyclic pattern in the case n = 3 
In this section we consider only the case n = 3 and the cyclic pattern 
/ = {(1,3),(2,1),(3,2)}GP^. 



By Theorem [311 I is universal. For A G L(3) let Oa = {UAU-^ : U G 
U(3)} be its orbit. Recall that A (or Oa) is said to be /-generic if Oa 
and Lj = Lj{3) intersect transversally. Since / is fixed, we shall drop 
the prefix "/-" and say just that A is generic. We denote by the set 
of nongeneric matrices in L{3). Clearly G is a closed U(n)-invariant 
subset. 

We shall study here the set 9, and the intersections Xa = Oa H Lj 
for generic A G L{3). In particular, we are interested in the possible 
values of the number, Na = Na,i, of Ts-orbits contained in Xa- 

First we consider the intersection BflL/. This set contains all points 
A E Lj such that Oa and Lj are not transversal at A. An arbitrary 
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matrix A & Lj can be written as 



(9.1) A 



u z 
V X 
y w 



w = —u — V. 



Define the homogeneous polynomial Pi : L/ — i> R of degree 6 in the 
real and imaginary parts of the complex variables x, y, z, u, v by: 

(9.2) Pi{A) = \{v-w)x^\^ + \{w-u)y^\^+\{u-v)z^\^ 

+ {\{v- w)x\'^ + |yz|^) ■ (|t;p + \w\'^ - 5|m|^) 
+ {\{w - n)yp + l^xp) ■ (|wp + |Mp - 5|i;p) 
+ (|(m - v)z\'^ + |xyp) ■ (|up + \v\'^ - 5|tt;p) 
+ \{u — v)(v — w){w — -u)!^. 

Proposition 9.1. For A & Lj as above, Oa and Lj intersect non- 
transversally at A iff A lies on the real hypersurface Fi C Lj defined 
by the equation Pi = 0. 

Proof. The tangent space to Oa at the point A consists of all matrices 
[A, X] = AX - XA with X* = -X and tr (X) = 0. If X is diagonal, 
then [A,X] G Lj. Let S be the subspace of skew-Hermitian matrices 
with all diagonal entries 0. We see immediately that Oa and Lj are 
transversal at A iS Lj + [A, S] = L{3). A routine computation shows 
that the latter condition is equivalent to the vanishing of a certain 
determinant, a homogeneous polynomial of degree 6. It is not hard to 
verify that this polynomial (unique up to a scalar factor) is Pi. D 

Corollary 9.2. We have 

(9.3) TiCenL/, 

(9.4) e = UAer.OA. 

Proof. The inclusion (19. 3p is obvious. If P G then there exists A G 
Xb such that Ob and Lj intersect non-transversally at A. Hence A eTi 
and P G Oa- Thus (I93D is valid. D 

Our next objective is to construct the (unique) irreducible real hy- 
persurface r in L{3) containing the set B. It is given by an equation 
P = 0, where P : L(3) -h> R is a homogeneous polynomial of degree 24 
in 16 variables, the real and imaginary parts of the entries of X G L{3) 
except the last entry. The polynomial P is invariant under the action 
of the direct product U(l) x SU(3), where U(l) acts by multiplication 
with scalars of unit modulus and SU(3) acts by conjugation. It can be 
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expressed as a polynomial in the invariants ii, 12, . . . ,iiQ listed in Ap- 
pendix A. As this expression has 203 terms, we shall give it separately 
in Appendix B. 

We warn the reader that P is rather large. Denote by Pj its restric- 
tion to the subspace Lj. We run out of memory if we try to evaluate 
Pj at an arbitrary matrix in Lj and expand it as a polynomial in the 
10 real variables (the real and imaginary parts of the complex variables 
x,y,z,u,v). However, when we set the imaginary parts of y and z to 
0, then we can expand Pj and obtain 130571 terms. If we additionally 
set the imaginary part of x to 0, then the number of terms goes down 
to 50583. 

Recall that the hypersurface T C L(3) is defined by the equation 
P = 0. 

Proposition 9.3. The restriction Pj admits the factorization: 

(9.5) Pi = P^P2, 

where Pi is defined by Ii9.2\) and P2 is a homogeneous polynomial of 
degree 12 with integer coefficients. Thus F fl L/ = Fi U r2, where F2 is 
the hypersurface defined by P2 = 0. We also have 6 C F. 

Proof. The first assertion can be verified by using a computer and suit- 
able software, e.g.. Maple [6|. The assertion that F fl L/ = Fi U F2 is 
now obvious. Finally, the assertion O C F follows from Corollary 19.21 
and the fact that O^ C F for A G F. D 

We prove next that Pi, P2 and P are irreducible. In fact we have a 
stronger result. 

Proposition 9.4. The real polynomials Pi, P2 and P defined above 
are absolutely irreducible (i.e., irreducible over C). 

Proof. The absolute irreducibility of Pi can be proved by using the "ab- 
sfact.lib" library in SINGULAR [2j. To make this computation easier, it 
suffices to check that after setting y = 2, z = 1, and setting the imagi- 
nary parts of X and f to and 1, respectively, the resulting polynomial 
(having 69 terms) still has degree 6 and is absolutely irreducible. 

The same method works for P2. In this case we set u = 1, y = 2, 
z = 1, and we also set the imaginary parts of x and f to and 1, 
respectively. We obtain an absolutely irreducible polynomial of degree 
12 (having 47 terms). 

It is much harder to prove that P is also absolutely irreducible. (We 
were not successful in using the same method as above.) Assume that 
P has a nontrivial factorization P = QR over C. We can assume that 
Q is irreducible. Since U(3) is connected and P is U(3)-invariant, both 
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Q and R must be invariant. By restricting these polynomials to Li and 
by using fl9.5p . we obtain that Pj = QiRi = -PfA- It follows that Qj 
is equal to Pi or P2 (up to a scalar factor). We are going to show that 
this leads to a contradiction. 
One can easily verify that, for 

' 3 + 3i 5 

A= 3-3i 5 eLi, 

5 -6 _ 

we have Pi (A) = and P2{A) = -22675690800, and so A G Ti \ Tg. 
On the other hand, the matrix 



B 



222 







Hi 



6V69 
69) 








v/222" 



6V69 







eL, 



1(1 + 769) 

satisfies Pi{B) = 89424 and PiiB) = 0, and so fi G Ta \ Ti. 

We obtain a contradiction by showing that B G Oa- An explicit 
unitary matrix X satisfying AX = XB is given in Appendix C D 

We note that, in the above proof, A is a regular point of Fi, while 
B is singular on r2. 

The subspace Lj is Z- invariant, for the cyclic matrix 

1 

1 
1 



Indeed, ii A E Lj is given by (19.11) then 



ZAZ- 



w 


y 








u 


z 


X 





V 



eLj. 



Assume now that A & Lj and that P{A) 7^ 0. We claim that the 
two points A, ZAZ^^ G X^ are not Ts-conjugate. Otherwise ZAZ^'^ = 
DAD~^ for some D E T^. This implies that u = v = w, and u + v + 
w = forces that u = v = w = 0. Consequently, Pi{A) = which 
contradicts our assumption. We conclude that the three points of the 
Z-orbit {A, ZAZ~^, Z~^AZ} belong to three different Ta-orbits in Xa- 
Since Pi is Z-invariant, we have 

P^(A) = Pi{ZAZ-^) = Pi{Z-^AZ). 

It follows that Na is divisible by 3. As A^^ = A^(A,M/(3)) by the 
remark [8751 and as we know that in this case A^(A, M/(3)) is even, we 
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conclude that A^^ is divisible by 6. Numerical computations indicate 
that Na is either 6 or 18 and that X^/T^ can be split into 6-tuples such 
that Pi is constant on the union of the Ts-orbits belonging to the same 
6-tuple. We have no explanation for this phenomenon. 
Let us look at an example. The matrices 



A 



1+i 
0-10 
1 -z 



and B 



-i 











-1 





1 





l + l 



belong to Lj. As Pi{A) = Pi{B) = 45 and P2{A) = P2{B) = 0, we 
have A, B G r2 \ Fi. One can easily verify that A and B are unitarily 
similar and are regular points of r2. Hence Xa contains the six T3- 
orbits with representatives Z'^AZ~^, Z^BZ~^ , fc = 0, 1, 2. We propose 
A and B as examples of generic points which belong to F, which would 
imply that 6 7^ F. 



10. Appendix A: Generators of U(1) x SU(3)-invariants 

Consider the representation of the direct product U(l) x SU(3) on 
L(3), where U(l) acts by multiplication with scalars of unit modulus 
and SU(3) acts by conjugation. The algebra of real polynomial invari- 
ants for this action is a subalgebra of the corresponding algebra for the 
conjugation action of U(3) on -L(3). A minimal set of homogeneous gen- 
erators of the first algebra consists of 16 invariants zi, ^2, • • • , He listed 
below. This fact is neither proved nor used in this paper. However, 
these generators are used in Sections [2] and [9] to construct some other 



ZERO PATTERNS AND UNITARY SIMILARITY 35 

invariants that we need. The 16 generators are 

21= tr(XF), Z2= tr(XV2), z3 = i|tr(X2)|2, 

24 = tr(XFXV2), 25 = i|tr(X3)|2, t, = \tT{X^Y)\'', 

t7 = -^ (ti (Y^)(3tT\X^Y) + tr(X=^)tr(Xr'))), 
6 

28 = -^(tT{Y^){3tT\X^Y) - tT{X^)tT{XY^))) , 

6 

29 = ^53(tr(r^)tr2(xV)), 

2io = ^S(tr(X2)tr^(XV)tr(r3)), 
2n = ^3?(tr2(X2)tr(r3)tr(Xr2)), 
2i2 = ^3(tr2(X2)tr(r3)tr(Xr2)), 
2i3 = ^3?(tr2(X3)tr3(r2)), 

t,,= ^%tT\X')tT^Y')), 

Zi, = ^'^{ti%X'Y)tT{Y')), 

^,, = ^^{tT\X')tT'{Y')tT\XY')), 

where X G -^(3) is an arbitrary matrix, Y = X* is its adjoint, and 
tr is the matrix trace function. The symbols 3fJ and S^ stand for "real 
part" and "imaginary part" , respectively. 



11. Appendix B: The polynomial P 

Here we construct the polynomial P used in Section [91 It will be 
given as a polynomial in the invariants ik listed in Appendix A. For 
convenience, we collect P with respect to the invariants 23 and iq 



k,l 



k-l 
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The nonzero Pki are as follows: 



Poo 
Poi 



PlO 



Pll = 



= -6 (126 i2^ii^ - 26 iiii^ + 336 ^7^2^!^ - 270 ia^^i^ + 1536 ij'^ 

+216 ^2^ - 11 irh^ + 2ii^ - 1152 ^7^2^) {is + k) 
= 18432 ^11^7 + 186 y 1^ + 2016 iuii\ + 2160 is^^i^? - 66 in^i^ 
+2160^8^1^2^ - 1278i8^i^^2 + 186ii^i7 - 6912^11^2^ + 3456 hir^ 
+3456^8^1^7- 1278 21^^2^7 

P02 = 3888 ^8^2 + 297 ii^is^- 4608^13 -324^2^ -90^^2 + 3888^2^7 
+9ii^ - 1242 iiV - 1242 28^1^ - 3456 iuii 

Po3 = 18^1 (-72x2 + 27^2) 

Po4 = 729 

= 6912 2724^1^2 + 2016 i2?i^^i3 - 33 ui2ii^ + 1008 ui2\^ 
-3456^4^1^2^ - 1008 24^^2^1^ + 31104^5^^2^ + 33^5^^ 
+297 i^W + 9792 ^2^ - 2304 u\ - 251 ii\ - 20736 i^Hs 
-3024^5^4^2^1^ + 25920 2722^ - 55296^7^^2 - 6912 ^7^4^ 
+ 17760 ^7^^!^ + 3456^4^^2^ + 9504i5i2^ii-'^ - 6912 ^7^5^!^ 
-66 21^13 + 4608 he - 24012 2722^^1^ - 317 2721^ - 62208 2725^ 
+2304^4222128 - 1206^5^2^1^ + 3012 ^2^1^ + 5226^2^1^ 
-20736272524 + 8544^721^28 - 6912i2^ii3 + 9216^7^13 + 66ii^iii 

-9072 25^2221^ - 23042521^28 - 27648 272228 - 6912 252428 
-11052 i2^«l^?8 + 13824^5222128 + 10368^5^4^2^ + 1632^2^^1^ 

-5151 i2\^ + 7200 ^2^21^ - 256 ^2^1^ + 16 ii^° - 1728 22^ 
-2016 2221^^11+41472^7^5^1^2 - 18432^7^1^11 + 6912^2^^1^11 
-20736 252122"'^ + 99 ^5^4^!^ + 33 24^ii^ 
-4320^5^2^1^ + 6ii\ + mUijH + 1728^4^^1 - 3450^1^ 
-5088 ii^iii + 14688 2122^ + 2721 ^2^1^ + 2304 ui^ - 4320 222128 
+ 15552^5^^1 + 1152 21^13 + 11520 25^8 - 3456^4^2^ + 1440 272122 
-207362522^ - 272^1^ + 1530^5^1^ - 33^4*1^ + 32256 22211 
+5184^5^4^1 - 9792^2^^1^ - 720^4^2^1^ + 39168^5 

P12 = -1728 ^4^1 + 2130 ii^ - 10170 2221^ + 15228 22^ + 1296 ig 
+ 129627-103682521 

Pi3 = -3726 21 
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P20 = -4272 ui2ii^ + 16128 i4«i«2^ - 16128 ^4^22 + 12816 ^5^4^!^ 
-48384 i5Hi2 + 4272 u\^ - 27360 i2\ + 23808 iris 
+80844^7^2^1^ + 69888 ^7^ - 47808^5^2^1^ + 117504^521^2^ 
-39168^7^5^1 + 19500^2^1^^8 - 8544^1^^13 + 32256^2^13 
+85AAiiHu + 384 ii^ + 20160^2^ - 128736^2^ - 11607^1^ 
+4470^5^1^ - 145152^5^^2 + 38448^5^^1^ - 2799 ii\ 
-11520^5^1^8 - 50016 i2^ii2 - 5279^2^1^ + 26283^2^^/ 
-32256 22^1^11 

P21 = -22224 ijii - 4272 i^ii^ - 37632 iu + 16128 ^4^2 + 96768 2522 
-2112^1^ + 18192^2^1^ - 15264 ^5^1^ - 8400^1^8 - 40608 21^2^ 

P22 = -10476^2 + 1040Hi2 

P30 = 44448 25^1^ + 31296 28^2 + 4415 21*^-76308^12^7 -18816^4^1^2 
+16934425=^ + 56448^5^4 + 128496 ^1^22^ + 37632 2nii 
-209664^5^1^2 + 18816 24^ - 9108 2321^ + 236352^2^7 
-37632 ii3 - 90624 ^2^ - 43032 ii% 

P31 = -117504^5 + 480^2^1 + 3312^1^-18816^4 

P32 = -5196 

P40 = -146816 ^2^1^ - 10384 ^8 + 112896 2521 + 23948 ii^ 
+ 195840^2^- 142480^7 



P41 = 33632 21 
P50 = -2020 
Pqo = 78400 



P50 = -202048^2 + 65232 ii^ 
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12. Appendix C: The unitary matrix X 

The entries of the unitary matrix X = [xij], used in the proof of 
Proposition I9.4[ are given by 

2 ( V69 -7) -i{3 + ^69) 



xn 



3^12 



6 ^37 - V69 

=(1 + 3i)(iV6 - V46), 

12^13 



x,s = ^{V46 + Vq), 



(3-i)V69 + 34 + 27i 

15 \/37 - ^69 
4 



Vie - Ve) + — ^= (23 Ve - 3 Vie) 



15^13 eoVi3 

eu 

2(2- V69)-i(3 + y69) 
6 ^37 - 769 



a;2i 
a;22 

3^23 

2:31 

^32 = T7^(^ + ^ + ^^;r7T^(23v^ + 3Vi6), 
15vl3 oUvl3 

X33 = ^(Vag-Vq). 
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